Network-based portal to manage communication

ABSTRACT

A computer-implemented system and method to manage the communication of a user are disclosed. In one embodiment, when a person tries to electronically convey a message to the user, the status of the user, the identity of the person, and the urgency of the message can be identified. The access priority of the person can be determined based on the person&#39;s identity. Then, the message can be managed using one or more rules and in view of the status of the user, the access priority of the person and the urgency of the message.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 14/922,344, filed Oct. 26, 2015, which is hereby incorporated herein by reference, which application is a continuation of U.S. patent application Ser. No. 14/272,632, filed May 8, 2014, now U.S. Pat. No. 9,204,268, and entitled “SYSTEMS AND PROCESSES TO MANAGE MULTIPLE MODES OF COMMUNICATION,” which is hereby incorporated herein by reference, which application is a continuation of U.S. patent application Ser. No. 12/798,995, filed Apr. 14, 2010, now U.S. Pat. No. 8,744,407, and entitled “SYSTEMS AND PROCESSES TO MANAGE MULTIPLE MODES OF COMMUNICATION,” which is hereby incorporated herein by reference, which application is a continuation of U.S. patent application Ser. No. 11/452,115, filed Jun. 12, 2006, now U.S. Pat. No. 7,729,688, and entitled “SYSTEMS AND PROCESSES TO MANAGE MULTIPLE MODES OF COMMUNICATION”, which is hereby incorporated herein by reference, which application is a continuation-in-part application of U.S. patent application Ser. No. 11/006,343, filed Dec. 7, 2004, now U.S. Pat. No. 7,116,976, and entitled “ADAPTABLE COMMUNICATION TECHNIQUES FOR ELECTRONIC DEVICES,” which is hereby incorporated herein by reference, which claims priority to U.S. Provisional Patent Application No. 60/527,565, filed Dec. 8, 2003, entitled “ADAPTABLE COMMUNICATION TECHNIQUES FOR ELECTRONIC DEVICES,” and which is hereby incorporated herein by reference.

This application, by way of U.S. patent application Ser. No. 11/452,115, also claims priority to U.S. Provisional Patent Application No. 60/689,686, filed Jun. 10, 2005, entitled “SYSTEMS AND PROCESSES TO MANAGE MULTIPLE MODES OF COMMUNICATION,” and which is hereby incorporated herein by reference.

BACKGROUND OF THE INVENTION

For many years, other than mails from post offices, we typically only received information from afar through telephones. However, in the past few years, ways that others can send us information have increased significantly. Just to list a few different modes of communication, we can be reached from standard desk phones, fax, cell phones, electronic mails, and instant messages. In addition, we can have more than one phone number and multiple electronic mail addresses. There are people we like to communicate with, and there are those we prefer to avoid. Managing information from all such different modes can be quite time consuming.

It should be apparent from the foregoing that there is still a need to help manage the numerous modes of communication.

SUMMARY OF THE INVENTION

Different embodiments of a computer-implemented system and method to manage the communication of a user are disclosed. A person tries to electronically convey a message to the user. In one embodiment, the status of the user is identified; the identity of the person is identified; the urgency of the message is identified; the access priority of the person is determined based on the person's identity; and a process is set to manage the message using one or more rules, and in view of the status of the user, the access priority of the person and the urgency of the message.

Based on different embodiments, the status of the user depends on the current activity or location of the user, or the current time. The status of the user can also be defined by the user. Similarly, the access priority of the person can be defined by the user, or is set depending on the user's reaction towards a prior message from the person. Also, the urgency of the message is set by the person.

The process can depend on the mode of communication of the message. For example, the mode of communication can include a mobile phone, an office phone, a home phone, a mobile SMS, a pager from a mobile phone or PDA, a home/office SMS, mobile online chat, home online chat, a voice mail with/without instant notification, an office fax, a home fax, a mobile email, and an email.

In one embodiment, the user receives the message through a handheld device, such as a cellular phone. In another embodiment, the message is electronically conveyed based on Internet protocol through a website.

In one embodiment, though the process allows the user to receive the message, the person is not aware of the contact information of the user. For example, the person is not aware of the phone number of the cellular phone that the user used to talk to the person. This prevents the person from directly accessing the user without going through an intermediate control, such as a website. Similarly, the user does not have to be aware of the contact information of the person.

In another embodiment, the defined access priority of the person is stored at a website, allowing the website to access such information without asking for the user's permission. In one embodiment, the defined access priority is stored in a private database under the user's control.

In one embodiment, text messages could be received in an audio manner, and audio messages could be sent as text messages.

Other aspects and advantages of the present invention will become apparent from the following detailed description, which, when taken in conjunction with the accompanying drawings, illustrates by way of example the principles of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a number of intelligent communication modes according to one embodiment of the invention.

FIG. 2 shows a number of contact classes according to one embodiment of the invention.

FIG. 3 shows a number of urgency classes according to one embodiment of the invention.

FIG. 4 shows a number of statuses of a user according to one embodiment of the invention.

FIG. 5 shows one embodiment of an example of an Access Priority Database according to one embodiment of the invention.

FIG. 6 is a communication system according to one embodiment of the invention.

FIG. 7 is a flow diagram of a personal call response process according to one embodiment of the invention.

FIG. 8 is a flow diagram of an audio message response process according to one embodiment of the invention.

FIG. 9 is a flow diagram of a text message response process according to one embodiment of the invention.

FIG. 10 is a flow diagram of an automated call response process according to one embodiment of the invention.

FIG. 11 is a flow diagram of a message presentation process according to one embodiment of the invention.

FIG. 12 is a flow diagram of a message presentation process according to one embodiment of the invention.

Same numerals in FIGS. 1-12 are assigned to similar elements in all the figures. Embodiments of the invention are discussed below with reference to FIGS. 1-12. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes as the invention extends beyond these limited embodiments.

DETAILED DESCRIPTION OF THE INVENTION

One embodiment of the invention can automatically remove unwanted communications. Certain communications are relatively easy to determine to be unwanted, such as marketing cold calls and wrong number calls. Other communications may be more difficult. They can depend not just on the sources of the communication, but also the conditions or status of the receiver (a user) of the communication. The status can be related to the user's current activity and/or location. For example, when the user is on a train going to work, the user probably does not mind chatting with his grandchild. However, if the user is having his yearly review meeting with his boss, the user probably would prefer to avoid the call from his grandchild, unless it is an emergency. Based on the embodiment, communications from sources the user wants to postpone receiving can be automatically diverted.

In one embodiment, the user can get appropriate notification on the source of the incoming communication request. The attributes of the notification can depend on the urgency of the communication and/or the status of the user.

The user may receive information from different modes of communication. For example, the user can have mobile phones, fixed lines at home or office, emails, SMS, and faxes, with their different numbers and/or addresses. One embodiment can help the user efficiently manage information from the different modes. The user only has to remember one specific address from one mode of communication. Through that address, the user can receive communications from all modes of communication, independent of where the user is, or the type of hardware the user has. This allows the user to efficiently maintain his communication from the numerous modes even when he is traveling. For example, the user does not have to change phones (and the phone numbers) when he moves from areas covering 3G to areas that do not.

A number of embodiments depend on the different modes of communication converging onto the internet protocol platform. A communication gateway or a portal is formed allowing the user to receive communications from numerous sources through different modes. This, in turn, could reduce the numerous addresses the user has to remember, to one address. For example, an e-mail address for the user can serve as an access identifier for the different communication addresses from different communication modes. The access identifier can become the user's digital identity. In one embodiment, the user's other types of identification, such as the user's driver licenser number, can be the user's access identifier.

One embodiment of the invention uses an open portal based on the web. Based on the portal, the user can securely determine who can reach him at what conditions. This can be done based on a status indicator. As an example, this indicator is determined according to the status of the user, the access priorities of the person trying to reach the user (or the relationship or the lack of relationship between the user and the person), and/or the urgency of the message from the person. The status of the user can be dynamically determined, based on the current condition(s) of the user. The portal can allow the user and the person to select different options, which can be modified as desired. For example, the relationship can be preset by the user and stored in a database, while the urgency of the message can be set by the person.

Thus, in one embodiment, the portal can be used to control the selection and setting of different intelligent communication modes for the user. These intelligent communication modes allow priorities of various kinds of communication options to be set by the user. The portal allows worldwide access to the user, and can dynamically determine, for example, whether a call initiated at different time by different callers should be accepted by the user in real-time or handled by other mechanisms. From this information, communication requests can be classified, for example, into different degrees of undesirability. Some requests can be automatically blocked from the user. Others can be diverted and handled by other mechanism, such as diverting a phone call to an email or voice mail.

In one embodiment, the portal or gateway also includes a database to keep track of the user's different contacts or acquaintances, and the access priorities of each contact. The user can modify information in the database, such as assigning and/or changing the priorities of the contacts. Based on the information (or lack of information) in the database of the contact trying to access the user, and based on the status of the user, the gateway can automatically select an intelligent mode of communication for the user. This selection can be done dynamically.

In one embodiment, the portal can dynamically change the access priorities of a caller trying to reach the user. For example, previously the caller is of high priority to the user, and the user has set her access priorities accordingly. Lately, every time the caller trying to reach the user, the request was denied. After a preset number of rejections, the portal can automatically send a message to the user, asking the user if the user would like to lower the access priority of the caller. If the response is affirmative, the caller's priority is automatically reduced.

In another embodiment, the user does not have to set priorities of each contact. The system monitors every call, and provides the contact's identity to the user. Based on the user's reaction to the call (e.g. accepting or rejecting it), the system automatically sets the contact's priorities. In one embodiment, the system can then query the user for approval on the setting, and allow the user to adjust it as necessary. In another embodiment, the system can continue to modify the caller's priorities based on the user's reaction to the caller's subsequent calls.

In one embodiment, the user could keep information he believes to be sensitive local in a different database. Such information can be stored securely under the user's direct control. The portal can retrieve information from the different database when required. In another embodiment, the user can restrict or limit such retrieval process.

Additional confidentiality can be provided. In one embodiment, using phone calls as an example, the user can be aware of the identity of the caller even without being informed of the number of the caller. Similarly, the caller can reach the user without being aware of the number of the phone the user is using to receive the call. The user can keep his location and/or status confidential but still can receive the communication. This can be useful because there are situations, for example, when the user does not want to disclose his contact information but the user needs to receive services provided by the caller.

One approach to maintain such confidentiality while maintaining real-time communication is based on a system that digitally identifies the identities of the caller and the receiver. Note that the term caller is used in general. It is not just limited to phone calls, but they can be any person or entity requesting to communicate with the user, such as trying to send a message to the user. As a separate note, the caller can also be a user of different embodiments of the invention.

After determining the identities, the system can establish connections between the caller and the user in real time. Though contacts are established, the system only needs to ensure the identities of the caller and the user to each other. However, the system does not have to disclose the phone numbers, electronic addresses, physical locations and/or other attributes of the caller and the user to each other. In one embodiment, real time implies that the time required for the identification is similar to the typical time required to set up, for example, a telephone call. The system can be a portal based on the web.

In one embodiment, a portal also holds the user's electronic calendar. The calendar can be programmable, with entries set by the user. The portal can automatically and securely set appointments for the user since the portal knows the identity of the caller, and the status and schedule of the user. For example, the appointment can be for a conference call.

To illustrate, in one embodiment, a portal provides a number of intelligent communication modes (ICM) for the user to select as shown in FIG. 1. There are three columns in the table. If the communication mode selected in the second column does not work, the portal automatically defaults to the corresponding approach in the third column. For example, under ICM 1, if the mobile phone is busy, default to voice mail. Some of the selections do not have any default because it may not be necessary to default. For example, under ICM 8, the incoming message goes directly to voice mail with instant notification to mobile devices of the user. The incoming message can usually go to voice mail. There is no need to default.

As a receiver of communication, the user can define a number of contact classes, as shown in FIG. 2. The user can set up a number of urgency classes, as shown in FIG. 3. The user can define a number of status, as shown in FIG. 4. Then, based on tables in FIGS. 1-4, the user can set up an Access Priority Database for different ContactClasses, as shown in FIG. 5.

As another example, the user can categorize the following contacts into the corresponding ContactClasses:

Alice (Wife) ContactClass1 Peter (Close Friend) ContactClass2 Colina (Close Friend's wife) ContactClass2

Peter wants to make a mobile phone call to the user. In one embodiment, Peter calls a portal. As an example, the portal can be the user's ISP. The portal first verifies the caller's identity to be Peter. This can be done, for example, by a public key challenge based on Peter having a public key digital certificate. In another example, Peter is also a registered user of the portal. Then, Peter's identity can be more readily identified or verified.

In one embodiment, after verification, a virtual address/number for the communication session is created allowing Peter to reach the user, which can be by phone. The user's phone number does not have to be disclosed to Peter. Similarly, Peter's mobile phone number does not have to be disclosed to the user. The portal can assure the user that the person calling is Peter based on an identification verification process, such as ones described above.

In establishing contact, the portal can access the user's database and determine that Peter belongs to ContactClass2. The database can, for example, be in the portal.

In another embodiment, the database is in a personal communication device of the user. The portal accesses the personal communication device to determine Peter's ContactClass.

Based on the ContactClass information, the status of the user and Peter's urgency setting, the user may receive Peter's call directly. As another example, Peter may be asked to leave a voice mail to the user, while the user is notified by a mobile short message regarding an incoming call from Peter.

As additional examples, in one embodiment, location information of the user could be determined based on GPS information from, for example, the user's cell phone.

In one embodiment, the user receives messages through a handheld device, such as a phone, and the phone has a switch. The switch can be a physical button or a software setting, such as a pull-down menu. The user could set his status dynamically by changing the physical or logical position of the switch. For example, one position can indicate that the user is very busy, and should only be interrupted by an urgent message from the user's closest contacts, such as his wife or parents. Another position can indicate that the user's status allows the user to receive any messages from anyone.

As explained above, based on an embodiment, a message is electronically conveyed by a central network server, such as a web server based on Internet protocol. A portal or gateway approach could provide general Internet access to one or more embodiments of the communication management systems so that users can configure the system behavior they desire. The portal or gateway can then facilitate download of a database or update thereto to a communication device, such as a phone.

Also, as explained above, based on an embodiment, a user could efficiently maintain his communication, and does not even have to change phones when he moves from areas covering 3G to areas that do not. These phones could be based on different communication mechanisms, such as GSM, CDMA, 3G and 4G systems. Also as explained above, the user could keep information in local databases, such as in such a phone. For example, the intelligent communication modes shown in FIG. 1 for the user to select are in the phone. The user could define the contact classes, such as the ones shown in FIG. 2; set up the urgency classes, such as the ones shown in FIG. 3; define the statuses, such as the ones shown in FIG. 4; set up the Access Priority Database, such as the one shown in FIG. 5; and categorize a number of the user's contacts into the corresponding ContactClasses, all in the phone. When a caller places a call to the phone, based on information previously set in the phone and based on the urgency class selected by the caller, the phone could automatically manage the communication. Note that the phone does not have to be a cellular phone. In one embodiment, the phone is a desk top phone.

Again as explained above, the person or the caller trying to contact the user could select different options. For example, the urgency of the message can be set by the caller. This selection is typically in the call setup phase. In one embodiment, the caller has pre-selected the urgency class before making the call. In another embodiment, if the caller has not selected the urgency class, the system could prompt the caller to input an urgency class or status before the call or message is routed to the user. In yet another embodiment, different urgency classes could be defined by the caller.

Different embodiments or implementations may yield different advantages. One advantage is that communications for users of electronic devices can be flexibly provided. Another advantage is that communication mode changes can be performed at an electronic device to better suit the needs or condition of the electronic device or user preferences. In still another advantage, a user can provide feedback to a caller without answering a voice call from the caller.

Another aspect of the invention pertains to improved approaches to respond to an incoming text message. The improved approaches enable a recipient to provide a reply message to an initiator. The incoming text message can be presented to the recipient with an audio or textual presentation. Thereafter, a reply text message can be sent back to the initiator. The recipient can form the reply text message by recording a brief audio message or entering a text message. In the case in which a brief audio message is used, the audio message can be automatically converted to a text message before being transmitted to the initiator.

Further, the computer-implemented methods and systems discussed above can be used in conjunction with one or more of the various approaches discussed in U.S. patent application Ser. No. 11/006,343. For example, the automated actions or decisions (e.g., intelligent secretary, decision 204 in FIG. 2, etc.) of U.S. patent application Ser. No. 11/006,343 can be automatically made by the systems/methods described above. Still further, the various approaches discussed in U.S. patent application Ser. No. 11/006,343 can be used in conjunction with one or more the various methods/systems discussed above. For example, the systems/methods described above can use the messaging approaches (e.g., audio or textual messages) described in U.S. patent application Ser. No. 11/006,343.

Different embodiments of the invention pertain to improved approaches for users of electronic devices to communicate with one another. The electronic devices have audio and/or textual output capabilities. The improved approaches can enable users to communicate in different ways depending on device configuration, user preferences, prior history, time or other criteria. In one embodiment, the communication between users is achieved by short audio or textual messages.

The electronic device can be any computing device having communication capabilities. Such computing devices can be referred to as communication devices. Examples of electronic devices include personal computers, personal digital assistants, pagers or mobile telephones.

Embodiments of the invention are discussed below with reference to FIGS. 6-12. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes as the invention extends beyond these limited embodiments.

FIG. 6 is a communication system 100 according to one embodiment of the invention. The communication system 100 can support different communication devices, including mobile telephones 102, computers 104 (e.g., personal computers) and/or wireless personal digital assistants (PDAs) 106. Users of the communication devices 102-106 can communicate with like or different communication devices. Each communication device 102-106 offers one or both of audio or textual communication capabilities. These communication devices 102-106 can inter-communicate with one another through a network 108. The network 108 can include one or more of voice networks and data networks. For example, one network is a data network providing a slow speed data channel for transmission of Short Message Service (SMS) messages (which are typically limited to 160 text characters) to a Short Message Service Center (SMSC) and then forwarded on to the destination. Besides short messages (e.g., SMS messages), the network 108 can also support other messaging protocols for sending and receiving enhanced messages (EMS), multimedia messages (MMS), email and fax messages. Other networks support faster data channels and voice channels, such as GPRS, UMTS, G4, GSM, CDMA and various protocols, such as UDP, TCP, WAP, PDP other protocols.

According to one embodiment of the invention, one of the communication devices 102-106 can send a short message to another of the communication devices 102-106. The short message can be text-based or audio-based. The sending communication device allows its user to create the short message as the user desires and/or as the device permits. For example, the user might interact with a keypad or keyboard to enter the short message, or the user might record audio inputs (e.g., speech) for the short message. The short message can then be sent to the receiving communication device. The sending of the short message may involve converting the short message from an audio message to a text message, or vice versa. Also, the receiving communication device can further convert the short message from audio-to-text or from text-to-audio. In any case, the short message is presented (e.g., displayed or played) to the user of the receiving communication device. The presentation can vary as the user desires or as the device permits.

One aspect of the invention pertains to improved approaches to respond to incoming voice calls. The improved approaches enable a called party (i.e., a party being called) to provide some information to a calling party without directly engaging in a voice call with the calling party. The called party can choose not to take the voice call from the calling party. Instead, the called party can provide the calling party with some limited information. The limited information can be provided in an audio or textual format. In one embodiment, the limited information provides the calling party with feedback as to why the voice call was not taken.

FIG. 7 is a flow diagram of a personal call response process 200 according to one embodiment of the invention. The personal call response process 200 is performed by an electronic device, such as a mobile communication device (e.g., mobile telephone). The personal call response process 200 begins with a decision 202 that determines whether there is an incoming voice call. When the decision 202 determines that there is no incoming voice call, then the personal call response process 200 awaits such a call. Once the decision 202 determines that there is an incoming voice call, a decision 204 determines whether the incoming voice call is to be answered. Typically, the user of the electronic device would signal the electronic device as to whether or not to answer the incoming voice call. Alternatively, the electronic device could automatically decide whether to answer the call.

When the decision 204 determines that the user desires the incoming voice call to be answered, the incoming voice call is answered 206 and the user engages 208 in a voice call with the calling party. A decision 210 then determines whether the call has ended. When the decision 210 determines that the call has not yet ended, then the personal call response process 200 can return to repeat the block 208 while the voice call continues. Once the decision 210 determines that the voice call has ended, then the personal call response process 200 ends.

When the decision 204 determines that the user does not desire to answer the incoming voice call, a decision 212 determines whether the user desires to provide an audio message to the calling party. When the decision 212 determines that the user does desire to provide an audio message to the calling party, an audio message is obtained and sent 214 to the calling party (caller).

Alternatively, when the decision 212 determines that the user does not desire to provide an audio message, a decision 216 determines whether the user desires to provide a text message to the calling party. When the decision 216 determines that the user desires to provide a text message to the calling party, a text message is obtained and sent 218 to the calling party.

Still further, when the decision 216 determines that the user does not desire to provide a text message to the calling party, a decision 220 determines whether the incoming voice call is to be directed to voice mail. When the decision 220 determines that the incoming voice call should be directed to voice mail, then the incoming voice call is directed 222 to voice mail. On the other hand, when the decision 220 determines that the incoming voice call is not to be directed to voice mail, the incoming voice call is dropped 224. Following the blocks 214, 218, 222 and 224, the personal call response process 200 is complete and ends.

In another embodiment, a personal call response process could announce the calling party to the called party (user). In announcing the calling party, the personal call response process would present the called party with information pertaining to the calling party (e.g., display or audio sound). Such information could, for example, help the called party to decide whether to answer the incoming voice call. The information can, for example, include one or more of name (individual or business), telephone number, or other caller identification. The information could also include status information of the calling party, such as position, health, mood, etc. As an example, the information could be presented to the user prior to the decision 204 of the personal call response process 200 shown in FIG. 7.

In still another embodiment, an automated decision process to decide whether to answer a call can be based on time (e.g., decision 204). For example, the called party can previously set a rule, such as that from midnight to 6 am, the party does not want to answer voice calls. Then, during this time period, the electronic device can automatically decide not to answer incoming calls. In one implementation, when the electronic device decides not to answer incoming calls, no indication of incoming calls will be provided to the called party. For example, from midnight to 6 am, the device would not produce any ring tone. Additionally, if desired, the called party can also configure the electronic device to automatically provide an audio message or a text message to the calling party (e.g., I'm asleep call me tomorrow”).

FIG. 8 is a flow diagram of an audio message response process 300 according to one embodiment of the invention. The audio message response process 300 is, for example, suitable for use as the processing carried out by block 214 illustrated in FIG. 7.

The audio message response process 300 initially answers 302 the incoming voice call. In this operation, the incoming voice call is answered 302 but not in a traditional way. Instead, the electronic circuitry associated with a mobile communication device (e.g., mobile telephone) that receives the incoming voice call operates to answer the incoming voice call for purposes of an audio message response. For example, a voice channel is established between the calling party and the mobile communication device, but the speaker and microphone of the mobile communication device are disabled. In effect, in such an embodiment, neither the called party nor the calling party perceives that the voice calling has been answered.

Next, one or more predetermined audio messages can be presented 304 by the mobile communication device. The presentation 304 of the one or more predetermined audio messages can, for example, be achieved by audio or visual means. For example, the predetermined audio messages can be audio output to a speaker associated with the mobile communication device for the called party or can be visual output (e.g., text) to a display of the mobile communication device for the called party (e.g., user of the mobile communication device).

A decision 306 then determines whether a predetermined audio message has been selected. Here, the decision 306 determines whether the user (i.e., called party) of the mobile communication device has selected one or more of the predetermined audio messages. When the decision 306 determines that a predetermined audio message has been selected, then the selected audio message is played 308 for the calling party. Here, the mobile communication device can output the selected audio message to the calling party over the voice channel. Typically, the mobile communication device of the called party would not produce an audible output at the mobile communication device, so that the called party would not be disturbed by the sending of the audio response. The predetermined audio messages are normally short messages (e.g., not more than 160 characters) so that the duration of time the voice channel is needed and/or the amount of network bandwidth consumed is minimal.

On the other hand, when the decision 306 determines that none of the predetermined audio messages have been selected, then a decision 310 determines whether a custom audio message is requested. A custom audio message is an audio message that is specifically provided for the calling party. When the decision 310 determines that a custom audio message is not being requested, then the audio message response process 300 returns to repeat the decision 306 and subsequent operations. Alternatively, when the decision 310 determines that a custom audio message is requested, then a custom audio message is recorded 312. Thereafter, the custom audio message that has been recorded can be played 314 for the calling party (caller). Here, typically, the custom audio message would be output by the mobile communication device of the called party over the voice channel to the calling party. Typically, the mobile communication device of the called party would not produce an audible output at the mobile communication device, so that the called party would not be disturbed by the sending of the audio response. The custom audio messages are also normally short messages (e.g., not more than 160 characters) so that the duration of time the voice channel is needed and/or the amount of network bandwidth consumed is minimal.

Following the operations 308 and 314, the incoming voice call is closed 316. In other words, after the selected audio message or the custom audio message is played 308, 314, the incoming voice call can be closed 316. Following the block 316, the audio message response process 300 is complete and ends.

The predetermined audio messages that are presented 304 to a called party can be determined in a static or dynamic manner. A static determination would, for example, be when the called party has previously set or recorded an audio message to be utilized. Typically, with static determination, the list of audio messages remains the same (i.e., static) until changed (e.g., by the called party). A dynamic determination would allow the audio messages in the list (or the ordering of the audio messages in the list) to change without specific action by the user or the called party. For example, the list or ordering of the audio messages can depend on preference settings, configuration information, or prior usage. Prior usage can include biasing the list of audio messages such that those messages being most often selected appear higher in the list. The list or ordering of the audio messages can also depend on the calling party, type of calling party, location of calling party or called party, and the like. The list of audio messages can be represented by text and/or graphics (e.g., icons).

The audio message response process 300 flexibly enables a user to either select one or more predetermined audio messages or provide a custom audio message to be used as an audio message response to a calling party. However, it should be recognized that, in other embodiments, an audio message response process can alternatively simply pertain to only providing a custom audio message, or only permitting selection of a predetermined audio message. Further, in still other embodiments, an audio message response process can first determine whether a custom audio message is to be provided before presenting predetermined audio messages. In yet other embodiments, an audio message response process can answer the incoming voice call later in the processing than operation 302 as shown in FIG. 8 (e.g., before operations 308 and 314).

FIG. 9 is a flow diagram of a text message response process 400 according to one embodiment of the invention. The text message response process 400 is, for example, processing performed by the block 218 illustrated in FIG. 7.

The text message response process 400 initially drops 402 the incoming voice call. Here, the information to be supplied to the calling party is a short text message; therefore, there is no need for a voice channel.

Next, one or more predetermined text messages are displayed 404. Here, the one or more predetermined text messages would normally be displayed on a display screen associated with the mobile communication device being utilized by the called party. A decision 406 then determines whether one (or more) of the predetermined text messages has been selected. When the decision 406 determines that a predetermined text message has been selected, then the selected text message is transmitted 408 to the caller (i.e., the calling party).

On the other hand, when the decision 406 determines that a predetermined text message has not been selected, then a decision 410 determines whether a custom text message is requested. When the decision 410 determines that a custom text message is not requested, then the text message response process 400 returns to repeat the decision 406 and subsequent operations. Alternatively, when the decision 410 determines that a custom text message is requested, then the custom text message is entered 412. Here, the called party interacts with the mobile communication device to enter the custom text message. Then, the custom text message is transmitted 414 to the caller. In one embodiment, the transmission 408, 414 of the text message can be performed over a communication network, such as a network having a Short Message Service Center (SMSC) supporting Short Message Service (SMS) messages. Following the transmission 408 of the selected text message or the transmission 414 of the custom text message, the text message response process 400 is complete and ends.

An alternative embodiment of a text message response process could operate to answer the incoming voice call and announce to the caller that a text message will be forthcoming. Then, the incoming voice call could be promptly dropped. This additional operation could, for example, be used with the text message response process 400 by providing an additional operation prior to the block 402 illustrated in FIG. 9.

The predetermined text messages being displayed 404 to a called party can be determined in a static or dynamic manner. A static determination would, for example, be a text message the called party has previously set or entered. Typically, with static determination, the list of text messages remains the same (i.e., static) until changed (e.g., by the called party). A dynamic determination would allow the text messages in the list (or the ordering of the text messages in the list) to change automatically, and not by the user. For example, the list or ordering of the text messages can depend on preference settings, configuration information, or prior usage. To illustrate, prior usage can include biasing the list of text messages such that those messages being most often selected appear higher in the list. The list or ordering of the text messages can also depend on the calling party, type of calling party, location of calling party or called party, and the like. The list of text messages can identify each text message with text (e.g., at least a portion of the corresponding text message, or an abbreviation) and/or graphics (e.g., icons).

The text message response process 400 flexibly enables a user to either select one or more predetermined text messages or provide a custom text message to be used as a text message response to a calling party. However, it should be recognized that, in other embodiments, a text message response process can alternatively simply pertain to only providing a custom text message, or only permitting selection of a predetermined text message. Further, in still other embodiments, a text message response process can first determine whether a custom text message is to be provided before presenting predetermined text messages.

FIG. 10 is a flow diagram of an automated call response process 500 according to one embodiment of the invention. The automatic call response process 500 is substantially similar in many ways to the personal call response process 200 illustrated in FIG. 7. However, the automated call response process 500 operates to reduce user input at the mobile communication device by making use of stored data pertaining to its hardware components, configuration or preferences. In this regard, the automatic call response process 500 includes a decision 502 that determines whether a head-set is active. When the decision 502 determines that a head-set is active, then the automatic call response process 500 can prefer, suggest or require the user to obtain and send 214 an audio message to the caller in response to an incoming voice call. Alternatively, when the decision 502 determines that a head-set is not active, then a decision 504 can determine whether a display is present. In other words, the decision 504 can determine whether the mobile communication device has a display. When the decision 504 determines that the mobile communication device does have a display, then the mobile communication device can operate to obtain and send 218 a text message to the caller. Of course, this assumes that the caller can support text messages even though they initially called with a voice call. Hence, in another embodiment, the automatic call response process can operate to query or obtain information regarding the caller's communication device capabilities.

An exemplary scenario of how the previously described automatic call response process could work according to one implementation is as follows:

1. From his mobile phone, Bill calls Tom's mobile phone.

2. Tom is alerted by his mobile phone of an incoming call. Optionally, caller information (i.e., pertaining to Bill) can be displayed or announced to Tom.

3. Tom can choose to answer the incoming call or decline to answer the call.

4. In the event that Tom declines to answer the call, Tom can have the opportunity to provide the caller with a brief audio or text message.

5. If an audio message is to be provided, then Tom can either record a personalized message or select one of a plurality of predetermined audio messages. In this case, the incoming call is answered by Tom's mobile phone and then the audio message is played for the caller, thereafter the call is dropped. The audio messages are typically brief (i.e., short), and examples of audio messages are: (i) “Will call in 10 minutes,” (ii) “Cannot talk now,” (iii) “I'm in a meeting,” or (iv) “Please don't call anymore.”

6. On the other hand, if a text message is to be provided, then Tom can either enter a personalized text message or select from a plurality of predetermined text messages. In this case, the incoming call is dropped, and the entered text message or the selected one of the predetermined text messages is sent. Examples of text messages are: (i) “Will call in 10 minutes,” (ii) “Cannot talk now,” (iii) “I'm in a meeting,” or (iv) “Please don't call anymore.” The text messages can be English (or other language) words or phrases, or can be condensed text strings (e.g., such as slang or chat language). In one embodiment, the predetermined text messages presented to Tom can be dependent on some criteria (i.e., automatically selected). Alternatively, it is possible that Tom might want to edit the predetermined text message, such can be permitted. As yet another example, the text message can embed dynamic information, such as position, e.g., “I'm in [position] now, so I'll get back to you later.” The position can be determined using a GPS receiver in the mobile phone or acquired by a remote computer and provided to the mobile phone. The position may also be further processed (locally or remotely) into a more user-friendly form, such as city, school, restaurant name, or street type addresses. The position could also be used above to assist the user in deciding whether to answer the incoming call or decline to answer the call.

7. If hardware components, configuration or preferences are taken into consideration, as illustrated in FIG. 10, the above scenario can be modified. For example, if Tom is using a head-set with his mobile phone, then an audio message may be most convenient, assuming that Tom wants to provide a particular (i.e., customized) message to Bill. The head-set allows Tom to record a brief audio message. Less conveniently, the head-set can be used to present a list of predetermined audio messages and allow Tom's selection therefrom by a button or voice-command.

8. If Tom is not using a head-set, then a text message response might be more suitable. This would typically require that Tom's mobile phone have a display and a keypad. Even so, without a head-set, Tom could still record an audio message, though such would likely be less convenient.

9. Tom can also not provide an audio message or a text message and simply let the incoming call roll-over into voice mail.

The exemplary scenario can also be used in a case where the called party is using one line but the mobile device has multi-line capabilities or call waiting. In such case, the mobile phone can enable the called party to provide a brief audio or text message to the calling party as noted above. Alternatively, the mobile phone can itself automatically (i.e., without user input) respond to the calling party via an audio or text message since the mobile phone is aware that the called party is on the other line.

In this aspect of the invention, the calling party and the called party often use mobile communication devices, such as mobile phones. However, the parties can alternatively use other electronic devices, such as a PDA, a computer, etc. Further, the option to provide a text response could be prevented if the caller's device is known to not support text messages.

The advantages of the previously described embodiments are numerous. Different embodiments or implementations may yield different advantages. One advantage is that communications for users of electronic devices can be flexibly provided. Another advantage is that communication mode changes can be performed at an electronic device to better suit the needs or condition of the electronic device or user preferences. In still another advantage, a user can provide feedback to a caller without answering a voice call from the caller.

Another aspect of the invention pertains to improved approaches to respond to an incoming text message. The improved approaches enable a recipient to provide a reply message to an initiator. The incoming text message can be presented to the recipient with an audio or textual presentation. Thereafter, a reply text message can be sent back to the initiator. The recipient can form the reply text message by recording a brief audio message or entering a text message. In the case in which a brief audio message is used, the audio message can be automatically converted to a text message before being transmitted to the initiator.

FIG. 11 is a flow diagram of a message presentation process 600 according to one embodiment of the invention. The message presentation process 600 is performed by an electronic device, such as a mobile communication device.

The message presentation process 600 begins with a decision 602 that determines whether an incoming text message is present. Typically, the incoming text message would be transmitted to the mobile communication device from another communication device. When the decision 602 determines that an incoming text message is not present, then the message presentation process 600 awaits such message. Once the decision 602 determines that an incoming text message has been received, a decision 604 determines whether an audio or text presentation is to be utilized. The decision 604 can be performed in a variety of different ways. For example, the determination of whether to utilize an audio or text presentation can be based on user input or can be automatically determined through a use of configuration or preference information or hardware components (e.g., display, speaker, head-set).

When the decision 604 determines that an audio presentation is to be utilized, the incoming text message is converted 606 to an audio message. For example, a text-to-speech conversion can be performed. In one embodiment, a user of the electronic device can be permitted to choose speech characteristics, such as a voice, tone, pace, accent, or mood, for the resulting speech. For example, a user could choose speech characteristics by preference settings. In another embodiment, the incoming text message can include or reference speech characteristics so that the initiator can control or influence speech characteristics. In still another embodiment, if the text to be converted contains condensed text (e.g., such as slang or chat language), the resulting speech can pertain to an uncondensed form of the text. The ability to convert from condensed text to resulting speech for uncondensed text can be facilitated by pattern matching. For example, in chat language “LOL” can be converted to an audio message for “lots of love.” In one implementation, a table can store audio messages corresponding to chat terms or phrases. In another implementation, a first table would store uncompressed terms or phrases corresponding to chat terms or phrases, and a second table would store audio messages corresponding to the uncompressed terms or phrases.

After the incoming text message is converted to the audio message, the audio message is played 608. Typically, the audio message is played 608 by the mobile communication device for the user. For example, the audio message can be output to a speaker of the mobile communication device or a headset used therewith. As a result, the user of the mobile wireless communication device receives an audio message even though the incoming message was a text message.

On the other hand, when the decision 604 determines that a text presentation is to be utilized, the incoming text message is displayed 610. Here, the incoming text message would be displayed 610 on a display associated with the mobile communication device. Following the blocks 608 and 610, the message presentation process 600 ends.

As discussed above, text-to-speech conversion can be invoked and performed on an electronic device, which may be a mobile communication device. While text-to-speech conversion, particularly if high quality is desired, requires substantial processing capabilities, mobile electronic devices, such as mobile communication devices, given their small form factor and price competition, tend to have limited processing capability. Accordingly, in one embodiment, text-to-speech conversion can be off-loaded from the mobile device. For example, a remote server computer can be provided the text message and produce the resulting audio message, and then supply the audio message to the mobile device. The remote server computer can be a networked server coupled to the network 108. One example of a networked server is a gateway computer for a wireless electronic device, such as a mobile telephone.

FIG. 12 is a flow diagram of a reply message process 700 according to one embodiment of the invention. The reply message process 700 is performed by an electronic device, such as a mobile communication device.

The reply message process 700 begins with a decision 702 that determines whether a reply message is to be sent. Typically, the reply message process 700 follows the presentation of an incoming text message to a user of a mobile communication device. Hence, the reply message to be sent is a reply to the incoming text message. However, in other embodiments, the reply message to be sent can be merely an initial message as opposed to a response to an earlier message.

In any case, when the decision 702 determines that a reply message is not to be sent, then the reply message process 700 ends or simply awaits the need to send a reply message. On the other hand, when the decision 702 determines that a reply message is to be sent, then a decision 704 determines whether an audio or text message is to be formed. The decision 704 can be performed in a variety of different ways. For example, the determination of whether to send an audio or text message can be based on user input or can be automatically determined through a use of configuration or preference information or hardware components (e.g., display, speaker, head-set).

When the decision 704 determines that an audio message is to be formed, then the reply message process 700 prompts 706 for an audio message. Here, the prompt 706 can be directed to the user of the mobile communication device. The prompt can be an audio or textual indication. Next, a decision 708 determines whether an audio message has been recorded. When the decision 708 determines that the audio message has not been recorded, then the reply message process 700 awaits the audio message. Once the decision 708 determines that the audio message has been recorded, then the audio message is converted 710 to a text message. In one embodiment, if the audio message recorded is greater than a maximum text message size (e.g., 150 or 160 characters), then the audio message can be shortened so that the resulting text message does not exceed the maximum text message size. One way to shorten the text message is to use abbreviations. For example, the words “For example” can be changed to “e.g.”. Such conversion can be again be performed by matching entries in tables. Another way to shorten is to remove non-essential text. Still another way to shorten is to clip off or truncate the text message at the maximum text message size. In another embodiment, the resulting text message might provide an indication that it was converted from an audio message. Following the block 710, the text message is transmitted 712 over a wireless network.

Alternatively, when the decision 704 determines that a text message is to be formed, then a text entry screen is displayed 714. Next, a decision 716 determines whether a text message has been entered. When the decision 716 determines that a text message has not yet been entered, then the reply message process 700 awaits entry of the text message. Once the text message has been entered, the text message is transmitted 712 over the wireless network. Following the block 712, the reply message process 700 ends.

Although the reply message process 700 provides for the user to enter a custom text or audio message, it should be understood that the reply message can alternatively be formed through use of semi-custom or predetermined reply messages from which the user of the mobile communication device can choose. The use of semi-custom or predetermined reply messages can be achieved as noted above in a number of embodiments, and can serve to simplify the conversion process.

An exemplary scenario of how message presentation and reply message processes could work according to one implementation of the second aspect is as follows:

1. From his mobile phone, Bill prepares and sends a text message to Tom's mobile phone.

2. Tom is alerted by his mobile phone of an incoming text message, such as by displaying at least a portion of the text message and/or otherwise notifying Tom of the text message.

3. Tom's mobile phone can decide whether to present the text message on a display screen of Tom's mobile phone, or to first convert the text message to an audio message and then present the audio message to Tom (e.g., play the audio message). Of course, Tom can interact with Tom's mobile phone to assist in making the determination on how to present the message.

4. Thereafter, if desired, Tom can prepare and send a reply message back to Bill. This reply message can be prepared initially as a text message or an audio message. Tom's mobile phone and/or Tom can determine whether the reply message is initially prepared as a text message or as an audio message. If an audio message is initially created, such audio message must be converted to a text message prior to transmission. Eventually, the reply message is sent to Bill as a text message. Tom's mobile phone can assist with the creation of the reply message through use of custom, semi-custom or predetermined reply message from which Tom and/or Tom's mobile phone can choose.

5. If Tom is using a head-set with his mobile phone, then an audio message may be more convenient, assuming that Tom wants to provide a particular (i.e., customized) message to Bill. The head-set allows Tom to easily record a brief audio message. Less conveniently, the head-set can be used to present a list of predetermined audio messages and allow Tom's selection therefrom by a button or voice-command.

6. If Tom is not using a head-set, then a text message response might be more suitable. This would typically require that Tom's mobile phone have a display and a keypad. Even so, without a head-set, Tom could still record an audio message, though such would likely be less convenient.

7. Tom can also not provide a reply message and simply not respond to the incoming text message. Alternatively, Tom can configure his mobile phone to automatically produce and send a reply message based on user settings or preferences, position, configuration, status, etc.

In this aspect of the invention, the calling party and the called party often use mobile communication devices, such as mobile phones. However, the parties can alternatively use other electronic devices, such as a PDA, a computer, etc.

The advantages of the invention exemplified by FIGS. 11-12 are numerous. Different embodiments or implementations may yield different advantages. One advantage is that communications for users of electronic devices can be flexibly provided. Another advantage is that communication mode changes can be performed at an electronic device to better suit the needs or condition of the electronic device or user preferences. Still another advantage is that conversion of an audio message to a text message facilitates use a low cost network (such as the SMS network). Another advantage is reduced network bandwidth load. Yet still another advantage is that the sender can get back a message in the same format as they sent the original message, though the recipient may use the message in a different format or mode (e.g., recipient hears the text message as an audio message).

Moreover, it should be noted that with regards to any of the embodiments in which a voice call or a text message is incoming to an electronic device, not only can the user of the mobile device take an action (e.g., button press or voice-command) to decline the call/message but also the electronic device itself can automatically decline the call/message such that the user is not disturbed. For example, an electronic device can be configured through user settings (e.g., preferences) to decline calls/messages matching certain criteria. Also, an auto reply message can be configured to be automatically sent in response to the call/message. For a known, undesired marketing caller/message sender, the electronic device can automatically send a reply message demanding the sender not to call or send messages anymore, and to remove your information from their database.

Text messages received or sent can optionally embed indications of speech characteristics to be used, should the text message be converted to an audio format. The speech characteristics can pertain to voice, tone, pace, accent, and/or mood. The speech characteristics for the resulting speech can be set in preference or configuration information, set on a per message basis by users, or set by evaluation of monitored data pertaining to the user.

Additionally, the messages being transmitted can be encrypted for security purposes.

In one embodiment, an electronic device performing communications using audio and/or text messages according to the invention can further integrate (or have tethered thereto) one or more electrical components for enhancing the hearing of the user of the electronic device. The electronic device will normally include a microphone and a speaker. The invention described herein can be considered an automated secretary for a user of an electronic device. The automated secretary can completely or partially respond to an incoming call/message so as to reduce disturbances to the user. The user can personalize the automated secretary through user settings (e.g., preferences), or the automated secretary can learn over time how to handle different incoming calls/messages. Besides handling or assisting the user with incoming calls/messages, the automated secretary can also assist with other activities, such as making calendar entries (e.g., meetings) in a calendar or responding to incoming callers/messages with relevant information pertaining to the user's schedule as maintained by the calendar (though the user could restrict such access to certain information and/or inquiring parties). For example, if an incoming text message asks “available for lunch today?”, the automated secretary can check the user's availability for lunch by way of the user's calendar, then if the user is not available the automated secretary can quickly informing the inquiring party of same or propose another date. On the other hand, if the lunch time period is available in the user's calendar, then the automated secretary can either directly respond to the inquiring party of acceptance or propose a response to the user for review, modification and/or transmission.

It should be obvious to those skilled in the art that a number of embodiments performing communications using voice as well as audio and/or text messages can be implemented using voice over Internet Protocol technologies, with signals delivered over the Web. For example, a calling party's communication or mobile device can include an adapter to convert voice signals to data packets before sending them over the Internet. A service provider can convert the packets back into voice signals before sending the voice signals to the called party's communication device. Similarly, embodiments can be implemented using voice over wireless protocols, such as Wi-Fi or Wi-Max networks. Using such technologies, computing devices can become communication devices.

The various embodiments, implementations, features and aspects of the invention noted above can be combined in various ways or used separately. Those skilled in the art will understand from the description that the invention can be equally applied to or used in other different settings with respect to various combinations, embodiments, implementations or features provided in the description herein.

The invention can be implemented in software, hardware or a combination of hardware and software. A number of embodiments of the invention can also be embodied as computer readable code on a computer readable medium. The computer readable medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer readable medium include read-only memory, random-access memory, CD-ROMs, magnetic tape, optical data storage devices, and carrier waves. The computer readable medium can also be distributed over network-coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

Numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will become obvious to those skilled in the art that the invention may be practiced without these specific details. The description and representation herein are the common meanings used by those experienced or skilled in the art to most effectively convey the substance of their work to others skilled in the art. In other instances, well-known methods, procedures, components, and circuitry have not been described in detail to avoid unnecessarily obscuring aspects of the present invention.

In the foregoing description, reference to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Further, the order of blocks in process flowcharts or diagrams representing one or more embodiments of the invention do not inherently indicate any particular order nor imply any limitations in the invention.

The many features and advantages of the present invention are apparent from the written description and, thus, it is intended by the appended claims to cover all such features and advantages of the invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation as illustrated and described. Hence, all suitable modifications and equivalents may be resorted to as falling within the scope of the invention. 

What is claimed is:
 1. A network-based portal at least based on the Internet protocol platform, comprising: a computing device; a storage medium comprising a plurality of instructions, when executed by the computing device, result in the computing device: receiving an electronic message with an identifier of a user, the electronic message from a device of a person, wherein the identifier with the electronic message indicates the person desiring to send the electronic message to the user; identifying the person; determining availability of the user to receive the electronic message; sending, to the device of the person, information regarding the availability of the user to receive the electronic message; providing a plurality of options to be a selected mode of communication for the message to be received by the device of the user, wherein the plurality of options include at least voice communication and written text communication, and wherein the message could be received by the device of the user in any of the plurality of options, all using the identifier of the user, at least in view of the network-based portal being based on the Internet protocol platform; and setting a process to enable the electronic message to be received by the device of the user, via the selected mode of communication, through use of contact information associated with the device of the user, in view of the user not blocking the person from accessing the user, wherein even when the message is received by the device of the user through the contact information associated with the device of the user, the contact information associated with the device of the user is not provided to the device of the person, and wherein the identifier of the user is different from the contact information associated with the device of the user. 